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(57) A storage system data duplication method for 
copying data of a plurality of logical volumes possessed 
by a first storage system to a second storage system 
includes the steps of: (a) copying the data of the plurality 
of logical volumes to the second storage system; (b) in- 
terrupting copying of the data of the plurality of logical 
volumes to the second storage system; (c) starting cop- 



FIG. 1 



ying of data of one or more of the plurality of logical vol- 
umes to the second storage system; and starting copy- 
ing of data of ones of the plurality of logical volumes oth- 
er than the one or more logical volumes to the second 
storage system as delayed from the step (c), shortening 
a time taken until completion of data duplication on rec- 
reation of a group of paired logical volumes in a volume 
group after remote copy is temporarily stopped. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to storage sys- 
tems for storing data for a computer to read and write 
and more particularly, to a storage system based on a 
method for duplicating data possessed by the storage 
system. 

[0002] Data of a disk subsystem (storage system) 
possessed by a main data center might be lost due to 
an accident such as an earthquake. In order to avoid 
such data loss, there is a method for recovering the data 
loss by previously creating a copy of the data in the disk 
subsystem (storage system), that is, by previously du- 
plicating the data. The data duplicating method has 
been already put in practical use in the form of a so- 
called remote copying function. 

[0003] The remote copying function is a function of not 
only providing a function of backuping the contents of 
data possessed by the main center into a remote center 
merely as data contents at a time point but also writing 
the data to be written even into a disk subsystem of the 
remote center when a host computer (host unit) of the 
main center issues a data write instruction to the disk 
subsystem. As a result, when some fault takes place in 
the system of the main center and this causes data of 
the disk subsystem of the main center not to be used, 
the processing of the main center can be immediately 
continued by using the data possessed by the disk sub- 
system of the remote center. 

[0004] In this case ; in orderto continue the processing 
of the main center, it is necessary that the disk subsys- 
tem of the remote center have data consistent to the da- 
ta of the main center at the time of the fault. In other 
words, the writing sequence of the data at the remote 
center must be consistent to the writing sequence of da- 
ta at the main center. 

[0005] Several techniques for holding such consisten- 
cy of the data writing sequence are disclosed. For ex- 
ample, in U.S. Patent No. 5,446,871 (JP-A-6-2901 25) 
and J P-A-1 1-85408, in a remote copying system for 
making a copy asynchronously with the data writing op- 
eration of a disk subsystem of a main center, a host unit 
or disk subsystem of a remote center executes wrlte- 
data reflecting operation on the basis of time information 
attached to the data. 

[0006] When a database is duplicated by a remote 
copy function, for example, data to be duplicated in- 
clude, e.g., a data main body of the database and log 
data having data writing histories written therein. The 
data main body is closely associated with the log data, 
so that, a transaction of a data writing took place, the 
data writing transaction is completed not only by writing 
the data main body into the database but also by writing 
the write contents into the log data, thus ensuring the 
consistency of the data contents. In such a database 
that the consistency of the data contents is ensured by 



the aforementioned method, system design is often 
made so that the data main body and log data are re- 
corded in different disk subsystem volumes from a view- 
point of reliability. Even when the data main body and 

5 log data stored in the respective volumes of the different 
disk subsystems are duplicated by the remote copying 
function, the contents of the data main body and log data 
copied to the volumes of the remote center must have 
a consistency. To this end, with respect to the remote 

io copying function, even when the data main body and 
log data are written to the volumes of the disk subsys- 
tems in the main center, data writing must be carried out 
in the same data writing sequence as in the main center 
even in the remote center. In order to realize this cur- 

15 rently, a pair of volumes is made by a volume (source 
volume of copy) possessed by the disk subsystem of 
the main center to be subjected to execution of a remote 
copy and a volume (target volume of copy) possessed 
by the disk subsystem of the remote center, a single 

20 group (which will be referred to as the volume group, 
hereinafter) is made by a set of such paired volumes 
and is collectively managed, whereby the data writing 
sequence at the remote center is held and the consist- 
ency of the data contents is ensured. 

25 [0007] And when the data main body or log data is 
transmitted from the main center to the remote center, 
the transmission may sometimes be carried out via a 
public network. 

30 SUMMARY OF THE INVENTION 

[0008] In the technique described above, a set (a 
group of paired logical volumes) of paired logical vol- 
umes requiring consistency of the data contents be- 

35 tween the main center and remote center must be con- 
trolled on a collective management basis as a single 
group (volume group). In such a control system, for ex- 
ample, when ones of a plurality of data transfer units 
forming data transfer lines for connection between the 

*o disk subsystems of the main center and remote center 
is stopped due to its scheduled maintenance or the like, 
for the purpose of maintaining the consistency of data 
contents, all the paired logical volumes within the vol- 
ume group must be put in their status wherein copying 

*5 from the copy source to the copy target is temporarily 
stopped (which status will be referred to as the suspend, 
hereinafter). After put in the suspend status, the paired 
logical volumes can be again duplicated (which will be 
called the paired volume recreation, hereinafter) by 

50 again booting the data transmission line so far stopped. 
[0009] In the collective management based on the 
volume group, however, even when ones of the data 
transfer units is stopped for example, the paired logical 
volumes not affected by maintaining the duplication 

55 have also been put in their suspend status and the sus- 
pend status has been continued until the rebooting of 
the stopped unit ends, for the purpose of maintaining 
the contents consistency. For this reason, in the paired 
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volume recreation after completion of the suspend sta- 
tus, as the capacity of an object to be subjected to re- 
mote copying operation is huge, a time taken until the 
completion of duplication (copy) upon the paired volume 
recreation becomes enormous. That is, when it is de- 
sired to send data (huge capacity) belonging to the re- 
spective paired logical volumes in the volume group 
from the copy source to the copy target, even the trans- 
mission of the data concurrently from the plurality of data 
transfer units in the subsystem, these plural data are 
sent onto a public network line having a capacity smaller 
than a total of the capacities of the data transfer units. 
For this reason, the time taken until completion of dupli- 
cation upon the paired volume recreation becomes 
enormous. 

[001 0] It is therefore an object of the present invention 
to provide a method for shortening a time taken until 
completion of data duplication upon recreation of a 
group of paired logical volumes in a volume group after 
remote copy is temporarily stopped. 
[001 1 ] The above object is attained by providing a da- 
ta duplicating method in a storage system for copying 
data of a plurality of logical volumes possessed by a first 
storage system to a second storage system. The meth- 
od includes a first step of starting copying of data of one 
of the plurality of logical volumes to the second storage 
system, and a second step of starting copying data of 
the other logical volumes than the one logical volume of 
to the second storage system. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0012] 

Fig. 1 schematically shows an arrangement of a re- 
mote copy system in an embodiment; 
Fig. 2 shows an arrangement of a disk subsystem 
in the embodiment; 

Fig. 3 is a conceptual view of how to determine a 
justified time; 

Fig. 4 is a flowchart showing a part of a procedure 
of operations at the time of stopping a data transfer 
unit; 

Fig. 5 is a continuation of Fig. 4; 

Fig. 6 shows status of paired logical volumes and 

transition status of the status management table in 

operations of steps; 

Fig. 7 is a continuation of Fig. 6; and 

Fig. 8 shows an example of display of a display 

screen of application software. 

DETAILED DESCRIPTION OF THE EMBODIMENTS 

[0013] The present invention is directed to a duplica- 
tion system for selecting ones of paired logical volumes 
in a volume group ensuring consistency of data contents 
and enabling sequential paired volume recreation of the 
volumes in the volume group on each volume basis, 
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when the system is put in its status (suspend) wherein 
copying of all the paired logical volumes in the volume 
group is temporarily stopped. In other words, in the prior 
art, it is necessary to perform simultaneous paired vol- 

5 ume recreation over all the paired logical volumes in the 
volume group due to the consistency of data contents; 
whereas, in the present invention, the logical volumes 
enabling immediate paired volume recreation are imme- 
diately subjected to the paired volume recreation, and 

10 the logical volume disabling the paired volume recrea- 
tion is subjected to the paired volume recreation after 
its disabled reason is removed (e.g., after restoration of 
a data transfer unit). As a result, since the capacity of 
the paired logical volumes after the disable reason of 

*5 the paired volume recreation is removed becomes 
smaller than that when the paired volume recreation is 
collectively carried out on each volume group basis, a 
time taken until completion of the duplication of the 
paired logical volumes in the volume group can be re- 

20 duced. 

[0014] In the present invention, since paired volume 
recreation is sequentially carried out on each volume 
basis, there is no consistency of the data contents with 
the target volume of copy during the paired volume rec- 

25 reation. If a fault occurs in any of the paired logical vol- 
umes, then the target volume of copy cannot be utilized 
for data restoration of the source volume of copy at the 
main center. This means that, when a database is taken 
as an example, the paired volume recreation is carried 

30 out with times shifted between the target volume of copy 
having the data main body already written thereto and 
the target volume of copy having the log data already 
written thereto, so that there is no consistency in the da- 
ta contents, so long as the paired volume recreation of 

35 the both data is not completed. 

[0015] Forthe purpose of avoiding this, in accordance 
with the present invention, prior to execution of the 
paired volume recreation, the disk subsystem makes a 
replication of the target volume of copy at the time of 

40 putting the system in its suspend status to a volume dif- 
ferent from the target volume of copy. Thereby, even 
when a fault takes place in any of the paired logical vol- 
umes during the paired volume recreation, data until the 
system was put in the suspend status can be restored 

43 by using the replication. 

[0016] Explanation will be made below as to an em- 
bodiment with reference to accompanying drawings. 
However, the present invention will not be limited to the 
following explanation. 

50 [0017] Fig. 1 is an arrangement of a system for dupli- 
cating data between two data centers each equipped 
with a host unit, respectively. 

[0018] A disk subsystem (MCU) 102 as a datastorage 
system in a main center 1 01 as well as a disk subsystem 
55 (RCU) 1 04 as a data storage system in a remote center 
103 are connected to each other without intervention of 
host units 105 and 106, thus realizing a remote copy 
system for duplicating data possessed by the MCU 1 02 
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to the RCU 104. 
[0019] In the main center 101, the MCU 102 is con- 
nected to the host unit 105 having a central processing 
unit (CPU) for data processing of read and write to the 
MCU 1 02 via an interface cable 1 07. The MCU 1 02 has 
a plurality of primary volumes" (P-VOLs) 108 (108-1, 

1 08-2 and 1 08-n) for storage of data to be read and 

written by the host unit 105. 

[0020] Meanwhile, in the remote center 103, the RCU 

1 04 is connected to the host unit 1 06 having a CPU via 
an interface cable 110. When the host unit 105 of the 
main center 101 cannot perform its main function due 
to a an accident, fault or the like, the host unit 1 06 per- 
forms the function in place of the host unit 1 05. Even in 
the case of any fault other than the accident, fault or the 
like, the processing different from that of the host unit 

105 of the main center 101 can be executed independ- 
ently of the host unit 105 by utilizing data stored in the 
RCU 104. Further, the RCU 104 has a plurality of sec- 
ondary volumes (S-VOLs) 111 (111-1, 111-2,..., and 
111 -n) and a plurality of third volumes (T-VOL's) 112 
(112-1, 112-2,..., and 112-n) for storage of data to be 
read and written by the host unit 106. 

[0021] When the host unit 1 05 in the main center 1 01 
issues a data write instruction to the primary volumes 

P-VOLs (108-1 , 108-2 and 108-n) possessed by the 

MCU 102, this write data instruction is sent toward the 
secondary volumes S-VOLs (111-1 , 111-2,..., and 111-n) 
through respective interface cables (109-1, 109-2,..., 
and 109-n) associated with the respective P-VOLs 

(108-1, 108-2 and 108-n) and S-VOLs (111-1, 

111-2,..., and 111-n). At this time, the write data sent 
from the interface cables are multiplexed by multiple 
lines and a public network interface l/F 130 on the way 
and then sent toward the secondary volumes S-VOLs 
via a specific public line 140 of the public network. That 
is, during copying operation of the write data to the sec- 
ondary volumes S-VOLs, all the write data are passed 
through the public line 140. Accordingly when the public 
line has a heavy traffic at a time, the line becomes a 
bottleneck. In this connection, the public network inter- 
face l/F 130 may be connected to the interface cable in 
a 1:1 relationship. 

[0022] In accordance with the present invention, in the 
paired volume recreation after temporary stoppage of 
the volume group which imposes a heavy traffic to the 
public line at a time, the traffic peak is dispersed with 
respect to time to shorten a time necessary for the 
paired volume recreation, which will be further explained 
later. 

[0023] Fig. 2 shows an internal structure of the MCU 
102. The MCU 102 includes an interface controller 1 1 5 
for data transfer from and to the host unit, a memory 116 
for temporarily storing data to be read or written by the 
host unit therein, a remote copy control information 
memory 11 7 for storing information about a storing ad- 
dress (storing location) of data to be written whose re- 
mote copy is temporarily stopped, magnetic disk drives 
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1 1 8 as a recording media for recording the data of the 
host unit 105 therein, a microprocessor 119 for control- 
ling transaction of these data, a disk array subsystem 
controller 1 20 for controlling these elements, and a serv- 

5 ice processor panel 121 on which a user can monitor an 
execution status of the remote copy and can set how to 
set the remote copy. In this case, the magnetic disk drive 
118 has such a plurality of primary volumes (P-VOLs) 
108 (108-1, 108-2,..., and 108-n) as shown in Fig. 1 for 

10 storage of data to be read and written by the host unit 
105. 

[0024] The MCU 1 02 shown in Fig. 2 has the interface 
controller 1 1 5 through which transmits and receives da- 
ta to and from the remote center 1 03. And extended from 

15 the interface controller 115 are such an interface cables 
(109-1, 109-2,..., and 109-n) as shown in Fig. 1. These 
interface cables are connected to the multiple line/public 
network interface l/F 130. The multiple line/public net- 
work interface l/F 130 transmits the data received from 

20 the respective interface cables to a multiple line/public 
network interface l/F 131 of the remote center via the 
public line 140. The multiple line/public network inter- 
face l/F 131 of the remote center is connected to the 
interface controller of the RCU 104 via the interface ca- 

25 bles. With this arrangement, when it is desired to per- 
form remote copy from the main center to the remote 
center, data transmission can be realized on mutually 
different communication lines associated with the re- 
spective logical volumes within each subsystem, but 

30 since communication of all the logical volumes is carried 
out through a single public line on the public network, 
load concentration takes place for the data transmis- 
sion. In the present invention, there is provided a meth- 
od for dispersing a concentrated load especially at the 

35 time of the paired volume re-synchronization with re- 
spect to time to shorten a time necessary for the paired 
volume re-synchronization. 

[0025] In this connection, interface cables 109 con- 
nected between the centers comprises, e.g., an optical 

40 fiber link or an optical fiber cable which is driven by an 
LED driving unit based on an interface protocol gener- 
ally known as fiber channel. The public line 140 is an 
electrical communication link such as a typical T3 or 
ATM network, while the public network interface l/F 130 

45 is a data transfer unit which is typical of a channel ex- 
tender or a fiber channel switch and which can extend 
an interface connection distance. Accordingly a general 
fiber channel, a T3 network or the like can be connected 
between the MCU 102 and RCU 104. 

so [0026] Explanation will be continued by turning again 
to Fig; 1 . The MCU 102 performs usual reading and writ- 
ing operation of data by the host unit 105 with respect 
to the P-VOLs 1 08 of the MCU 1 02, and also performs 
control of copying operation of the data of the P-VOLs 

55 108 to the S-VOLs 111 of the RCU 1 04. 

[0027] More specifically, the MCU 1 02 manages the 
structure of the paired logical volumes and the copy ex- 
ecution status of the paired logical volumes that are 
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formed by a pair of the P-VOL 108 and the S-VOL 111 
as a copy target, for example, by a pair of the P-VOL 
108-1 and S-VOL 111-1 or by a pair of the P-VOL 108-2 
and S-VOL 111-2, and so on. The RCU 104 manages 
the write execution of data transmitted from the MCU 
102 and the structure and status of the paired logical 
volumes. 

[0028] In this connection, the word "status" shows a 
copy execution status between the P-VOL 108 and 
S-VOL 1 1 1 and has two status of 'duplex' and 'suspend'. 
The 'duplex* means a duplication status in which a 
paired relationship between the P-VOL 108 and S-VOL 

111 is maintained, and in other words, it also a status in 
which it reflects the writing operation of the P-VOLs 1 08 
sequentially on the S-VOLs 111 . The 'suspend* means 
a status in which reflecting operation of the write data 
of the P-VOLs 108 on the S-VOLs 111 is temporarily 
stopped with the paired relationship therebetween 
maintained. These status can be transited by a com- 
mand which is issued from an application 113, 114, the 
service processor panel 121 of the disk subsystem or 
an application of a console connected directly to the disk 
subsystem by a LAN to the paired logical volumes. 
[0029] In the present embodiment, also, it is assumed 
that a volume group having the consistency of data con- 
tents includes paired logical volumes of the P-VOL 1 08 
and S-VOL 111 . Thus, when the paired logical volumes 
are in their duplex status, the writing sequence of the 
P-VOLs 1 08 is made to coincide with the write reflecting 
sequence to provide a consistency to the data contents 
of the P-VOLs 108 and S-VOLs 111. 

[0030] Further, T-VOLs 112 possessed by the RCU 
1 04 in the present invention are a group of logical vol- 
umes in which a replication of the S-VOLs 1 1 1 are stored 
when all the paired logical volumes of the P-VOL 108 
and S-VOL 111 defined as a volume group are put in the 
suspend status. In this case, a technique for making 
copies of the S-VOLs 111 to the T-VOLs 112 in the 
present embodiment is not described in detail herein. 
However, the remote copy function is a technique for 
duplicating data between the disk subsystems, while the 
copy making technique utilizes a known technique for 
duplicating data within the same disk subsystem, in the 
present.embodiment, the S-VOLs 111 and the T-VOLs 

112 within the same disk subsystem form a pair of paired 
logical volumes and the data of the S-VOLs 111 are du- 
plicated to the T-VOLs 112. 

[0031] Fig. 4 and Fig. 5 (a continuation of Fig. 4) show, 
when data is duplicated by the MCU 1 02 and RCU 1 04 
in the remote copy arrangement of Fig. 1 , a processing 
procedure for explaining how to temporarily stop the 
copying or duplicating operation of all the paired logical 
volumes in the volume group by an unexpected accident 
or an intended stoppage caused by the maintenance of 
a part of the data transfer units formed by the interface 
cables 109 and multiple line/public network interface I/ 
F 130, and then how to again duplicate all the paired 
logical volumes in the volume group. Explanation will be 



detailed as to a procedure of shortening a time neces- 
sary for the duplication of ail the paired logical volumes 
after temporary stoppage of the copying operation in the 
present invention, by referring to these drawings. In this 
5 connection, in order to explain the status of each paired 
logical volume, the following description will be made as 
necessary by referring to Fig. 6 and Fig. 7 (a continua- 
tion of Fig. 6). 

[0032] Explanation will first be made as to the as- 

10 sumption conditions of the operation. It is assumed that, 
prior to stoppage of the data transfer units (forming the 
interface cables), the P-VOLs 108 in the MCU 102 and 
the S-VOLs 111 in the RCU 104 are formed as paired 
logical volumes, the S-VOLs 1 1 1 and T-VOLs 1 1 2 in the 

15 RCU 1 04 are formed as paired logical volumes, and the 
status of the paired logical volumes are of the duplex. 
Under this conditions, when the host unit 1 05 writes the 
respective P-VOLs 1 08 of the MCU 1 02, the remotecop- 
ying operation causes the S-VOLs 111 in the RCU 104 

20 to reflect the write data and also causes the T-VOLs 112 
making a pair with the S-VOL 1 1 1 to reflect the write data 
via the S-VOL 111 in the RCU 104, thus resulting in that 
the data contents are made identical between these 
three logical volumes. 

25 [0033] It is also assumed that, as has been explained 
Figs. 1 and 2, there are a plurality of the interface cables 
109 (109-1, 109-2,..., and 109-n) for data transfer be- 
tween the MCU 1 02 and RCU 1 04, and the data transfer 
of the paired logical volumes of the P-VOL 108 and 

30 S-VOL 1 1 1 is carried out independently of the respective 
interface cables. For example, a pair of the P-VOL 108-1 
and S-VOL 111-1 is associated with the interface cable 
1 09-1 . Accordingly, when a part of the data transfer units 
forming the interface cables 109 is stopped by an in- 

35 tended stoppage for its maintenance or by an accident, 
one of the paired logical volumes of the P-VOL 1 08 and 
S-VOL 111 so far using the interface cable including the 
stopped data transfer unit cannot perform its data trans- 
fer, which means that a fault took place in the paired 

40 logical volumes. In this connection, the data transfer 
units forming the interface cables include, in addition to 
the main bodies of the interface cables, the public net- 
work interface l/F 130 and a transmission control circuit 
part included in the interface controller 115 connected 

45 to the interface cables (109-1, 109-2,..., and 109-n), 
though not shown in Fig. 2. 

[0034] The assumptions have been explained. Expla- 
nation will next be made in detail as to the paired volume 
re-synchronization after the stoppage of the data trans- 
50 fer unit, by dividing the explanation into two cases when 
the unit stoppage is made by an unexpected accident 
and when the unit stoppage is made by an intended 
stoppage. 



[0035] When a fault took place in a part of a plurality 
of data transfer units forming the interface cables 109 
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and multiple line/public network interface l/F 130 (step 
201 In Fig. 4), the MCU 102 has expected a response 
indicative of data acceptance from the RCU 1 04 but ac- 
tually detects no response, whereas, the RCU 104 de- 
tects no data transmission from the MCU 102, whereby 
the MCU 102 and RCU 104 judge that the duplication 
of the paired logical volumes cannot be maintained. 
[0036] Next the MCU 1 02 changes 'enable' to 'disable' 
of an attribute of the P-VOL 1 08 in question which can- 
not maintain the maintenance of the duplication in a sta- 
tus management table managed by the MCU 1 02 (refer 
to Figs. 6 and 7) (step 202). In this case : the status man- 
agement table is a table which is possessed and man- 
aged by the MCU 102 and RCU 104 and is shown in 
Figs. 6 and 7. 

[0037] The status management table of the MCU 1 02 
in Figs. 6 and 7 manages logical volume numbers 601 
(manufacturing number of the disk subsystem ("0" in the 
drawings) and logical volume numbers ("0:01" and "0: 
02" in the drawings) of the disk subsystem) of the 
P-VOLs 108; copy execution statuses 602 of "duplex" 
and "suspend" of the P-VOLs 108; logical volume num- 
bers(the manufacturing number of the disk subsystem 
as a target pair party and the logical volume number of 
the disk subsystem in question) 603 of the S-VOLs 111 
forming pairs with the P-VOLs 108; and attributes 604 
indicative of "enable" or "disable" paired volume recre- 
ation of the S-VOLs 111. Meanwhile, the status manage- 
ment table of the RCU 1 04 in the Figs. 6 and 7 manages 
logical volume numbers 605 (the manufacturing number 
(V in the drawings) of the disk subsystem as a target 
pair party and the logical volume numbers ("0:01" and 
"0:02" in the drawings) of the disk subsystem in ques- 
tion) of the S-VOLs 111; and copy execution statuses 
606 of "duplex" and "suspend" of the S-VOLs 111 . 
[0038] With respect to the contents of the status man- 
agement tables, before the user makes pairs, the RCU 
104 as target pair part and the logical volumes under 
control of the RCU 104 are previously registered in the 
MCU 102. Further, the 'attribute' is used, after all the 
logical volumes in a volume group (to be described later) 
were changed to the "suspend" status, to determine the 
disk subsystem automatically determines which one of 
the paired logical volumes in the volume group for a 
paired volume recreation. The paired logical volume 
having the attribute of "enable" is the one which can 
make a pair immediately after all the paired logical vol- 
umes in the volume group were changed to the suspend 
status; whereas, the attribute of "disable" means the one 
which cannot make a pair thereafter. Explanation will be 
made on the assumption that a volume group contains 
two paired logical volumes in Figs. 6 and 7. 
[0039] The status of the logical volumes and state of 
the status management tables of the MCU 1 02 and RCU 
1 04 at the time of finishing the operation of the step 202 
of Fig. 4 correspond to a division (1) in Fig. 6. 
[0040] When the MCU 1 02 and RCU 1 04 then detect 
a fault in the data transfer units, they temporarily stop 
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(suspend status) the transfer and reflection of all the 
write data from the P-VOLs 108 to the RCU 104 (step 
203). All the paired logical volumes associated with the 
P-VOLs 1 08 defined as the volume group are suspend- 

5 ed. This is because, when the paired logical volume of 
the faulty data transfer unit is stopped and simultane- 
ously when the other paired logical volume in the volume 
group is operated, this causes a shift of the consistency 
between the paired logical volumes of the volume group, 

10 which leads to the fact that the consistency in the data 
contents between the logical volumes in the volume 
group cannot be maintained any longer. That is, for the 
purpose of maintaining the consistency, all the paired 
logical volumes in the volume group are put in the sus- 

is pend status to suppress occurrence of the inconsistency 
between the P-VOL and S-VOL and to ensure the data 
consistency. In the illustrated example, further, the con- 
tents of the S-VOLs at the time of the fault occurrence 
are alt reflected on the T-VOLs. Meanwhile, when the 

20 volume group is not defined, the need for ensuring the 
consistency can be eliminated. Thus when one data 
transfer unit is stopped due to a fault, the status of the 
paired logical volumes so far using the faulty data trans- 
fer unit for transfer of the write data is changed from the 

25 duplex status to the suspend. 

[0041] In the step 203, the P-VOL 1 08 and S-VOL 111 
defined as the volume group by the respective status 
management tables are changed from the "duplex" to 
the "suspend" (division (2) in Fig. 6). As a result, ail the 

30 paired logical volumes in the volume group are put in 
the "suspend" status, the reflection of the write data from 
the P-VOLs 108 to the S-VOLs 111 is interrupted, with 
the result that the data contents of the P-VOLs 1 08 co- 
incides with those of the S-VOLs 111. Therefore, the sta- 

35 tus of the paired logical volumes at the time of finishing 
the operation of the step 203 and the state of the status 
management tables of the MCU 102 and RCU 104 cor- 
respond to the division (2) in Fig. 6. 
[0042] In the RCU 104, next, when the status of the 

40 S-VOLs 1 1 1 is changed to the "suspend", the paired log- 
ical volumes of the S-VOL 111 and T-VOL 112 in the 
RCU 1 04 are put in the suspend status (step 204). The 
data contents of the T-VOLs 1 1 2 at this time point coin- 
cides with those of the S-VOLs 1 1 1 at the time of putting 

is all the paired logical volumes in the volume group in the 
suspend status. In the subsequent steps, even when the 
data contents of the S-VOLs 111 is changed, the data 
contents of the T-VOLs 112 will not be changed. Mean- 
while, the status of the paired logical volumes at the time 

50 of finishing the operation of the step 204 of Fig. 4 and 
the state of the status management tables of the MCU 
and RCU correspond to a division (3) of Fig. 6. 
[0043] Next the RCU 104, when all the status of the 
paired logical volumes of the S-VOLs 111 and T-VOLs 

55 112 are changed to the "suspend", reports the suspend 
completion to the MCU 1 02, which in turn accepts the 
report from the RCU 104 (step 205). 
[0044] The MCU 102, when accepting the report, 
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specifies one of the P-VOLs 108 having the attribute of 
"enable" in the status management table, and performs 
the paired volume recreation over the paired logical vol- 
ume making a pair with the S-VOL 111 (step 206 in Fig. 
5). That is, the MCU 102 changes the status of the log- 
ical volume of the attribute "enable" in the status man- 
agement table from the "suspeid" to the "duplex", trans- 
fers the write data of the P-VOL 108 to the S-VOL 111; 
whereas, the RCU 104 accepts the write data to reflect 
it on the S-VOL 111 , and informs the MCU 102 of the 
data acceptance. Accordingly, In the middle of the op- 
eration of the step 206 in Fig. 5, the status of the paired 
logical volumes and the state of the status management 
tables of the MCU and RCU correspond to a division (4) 
in Fig. 7. That is, during this period, the paired logical 
volumes in the volume group have two statuses of "sus- 
pend" and "duplex", and only for the paired logical vol- 
ume in the "duplex" status . the write data of the P-VOL 
108 are reflected (or written) on the S-VOL 111. 
[0045] During this period, an updating or writing se- 
quence of the paired logical volumes of the status "du- 
plex" is maintained, whereas, the paired logical volumes 
of the status "suspend", when accepting the write data 
from the host unit, will not transfer the data to the S-VOL 
111 and holds information about the storage position of 
the write data in the remote copy control information 
storage 117. 

[0046] Thereafter when it is desired to recreate the 
paired logical volumes in the "suspend" status, the MCU 
1 02 makes a copy of data corresponding to an updated 
or written part of the P-VOL 1 08 after changed to the 
suspend status to the S-VOL 111 on the basis of the 
inlormation at the storage location . At this time, the MCU 
102. when accepting the written data from the host unit 
during the copying operation, performs operation of re- 
flecting the written data holding the writing sequence 
concurrently with the copying operation, as in the case 
of the above "duplex" status. As a result, the writing se- 
quence of the paired logical volumes to be subjected to 
the paired volume recreation is ensured. 
[0047] Further, in the operation of the step 206, when 
there are paired logical volumes not having a notification 
of data acceptance from the RCU 104, this means that 
the MCU 1 02 tried to transfer the data to the RCU 1 04 
but could not transfer it for some reason. Thus the at- 
tributes associated with the paired logical volumes are 
changed to "disable" (step 207 in Fig. 5). The status of 
the paired logical volumes in the step 207 and the state 
change of the status management tables of the MCU 
and RCU are illustrated. 

[0048] Meanwhile, the user continuously monitors pe- 
riodically the status and attribute of the paired logical 
volumes in the volume group on the application 113 dur- 
ing the paired volume recreation to confirm that all the 
paired logical volumes of the "enable" attribute have the 
"duplex" status (step 208). The reason why the user 
continuously monitors the status and attribute is to con- 
firm that all the paired logical volumes not affected by 



the stoppage of the data transfer unit were duplicated. 
[0049] Fig. 8 shows a display of a display screen on 
the application 1 1 3 for the user to confirm the above sta- 
tus and attribute. Information displayed on the screen 

s include a justified time (00:00:00) in a volume group 
(VG#=0001 ), configuration information about the P-VOL 
1 08 of the MCU 1 02 and the S-VOL 1 1 1 of the RCU 1 04 
to be formed as paired logical volumes, and the status 
and paired volume recreation attribute of the paired log- 

10 jcal volumes. In an example of Fig. 8, four paired logical 
volumes are included in the volume group, volume num- 
bers of "0:0r and "0:02" have a paired volume recrea- 
tion attribute of "enable" and a status of "duplex", which 
means that the volumes are already duplicated. The log- 

15 jcal volume "0:03", which has a paired volume recrea- 
tion attribute of "enable" and a status of "suspend" , in- 
dicates a state to be next carried out in the step 206. 
That is, under this condition, the disk subsystem boots 
the paired volume re-synchronization. The logical vol- 

20 ume "0:04", which has a paired volume recreation at- 
tribute of "disable", indicates that the interface cable cur- 
rently being used by the paired logical volumes is faulty. 
[0050] It is assumed in this case that the application 
113 has a function of periodically collecting the paired 

25 volume recreation attribute and status as necessary 
from the disk subsystem and displaying such a table as 
shown in Fig. 8. Further, the "justified time" in Fig. 8 is 
a time on the basis of which a part of the write data ac- 
cepted from the host unit until a given time is consistent 

30 in both sides of the MCU and RCU, which means that 
the data of the MCU and RCU sides are consistent. 
More specifically, at the time point of accepting the write 
data from the host unit, the MCU attaches a sequence 
number indicative of a writing order and a time (time 

35 stamp) of the write acceptance to the write data, and 
then transfers it to the RCU. In this connection, in times 
attached to the copy data received by the RCU, one of 
times continually arranged without any skip in the se- 
quence number order, which is attached to copy data 

40 having the latest sequence number, is the justified time. 
Accordingly the application 113 can know completion of 
the duplication of a part of the data until a given time by 
looking at the justified time. The conception of the justi- 
fied time using two MCUs will be explained (by referring 

45 to Fig. 3). 

[0051] Turning again to the explanation of Fig. 5, the 
user removes the cause which led to the "suspend" of 
the paired logical volumes in the volume group. That is, 
the user removes the fault from the faulty data transfer 

50 units with a desired work and thereafter reboots them 
(step 209 in Fig. 5). 

[0052] The user next issues an instruction on the ap- 
plication 113 to recreate all ones of the paired logical 
volumes in the volume group which are other than the 
55 already- recreated paired volumes in the foregoing and 
which have the attribute "disable". The MCU 1 02, when 
accepting the instruction, transfers the write data of the 
P-VOLs 108 to the S-VOLs 111 as in the above case of 
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the paired volume recreation; whereas the RCU 1 04 ac- 
cepts the write data, reflects it on the S-VOLs 111 , and 
informs the MCU 1 02 of the data acceptance (step 21 0). 
A division (5) of Fig. 7 corresponds to the status of the 
paired logical volumes and the state of the status man- 5 
agement tables of the MCU 102 and RCU 104 at the 
time point of completion of the operation of the step 210 
in Fig. 5. 

[0053] The user confirms on the application 113 that 
all the paired logical volumes in the volume group were 10 
changed to the "duplex" status. Since all the paired log- 
ical volumes associated with the P-VOLs 108 defined 
as the volume group were duplicated, the MCU 102 
changes all the attributes of the status management ta- 
ble to the "enable". This means that the paired volume is 
recreation of the volume group has been completed 
(step 211). 

[0054] For preparation of the next paired volume rec- 
reation, the user issues an instruction to the MCU 1 02 
on the application 114 to recreate a pair of the S-VOL 20 
111 and T-VOL 112 (step 212), and the RCU 104 exe- 
cutes recreation of the paired logical volumes of the 
S-VOL 111 and T-VOL 112 according to the instruction 
from the MCU 1 02. The status of the paired logical vol- 
umes and the state of the status management tables of 25 
the MCU 1 02 and RCU 1 04 at the time point of comple-. 
tion of the operation of the step 212 in Fig. 5 correspond 
to a division (6) in Fig. 7. However, the status of the 
paired logical volumes in this division is the same as that 
of the division (1) of Fig. 6. 30 
[0055] The summary of the above step is that, in the 
step 206, the paired volume re-synchronization of the 
paired logical volumes other than the paired logical vol- 
umes using the interface cable including the faulty data 
transfer unit was restarted. In other words, in this con- 35 
dition, the paired volume re-synchronization of the 
paired logical volumes associated with the not-faulty or 
normal interface cables is executed, while the paired 
volume re-synchronization (step 210) of the paired log- 
ical volumes so far using the faulty interface cable are 40 
not executed yet. And when compared with the conven- 
tional case where, when the fault is restored, the paired 
volume re-synchronization of all the paired logical vol- 
umes in the volume group is started; the paired volume 
re-synchronization of the paired logical volumes asso- *s 
ciated with the normal interface cables as well as the 
paired volume re-synchronization of the paired logical 
volumes so far using the faulty interface cable are exe- 
cuted with a time shift (a time difference between the 
steps 206 and 210). Accordingly the data transfer load so 
of the public line 140 involved by the paired volume re- 
synchronization already explained in Fig. 1 will be dis- 
persed with respect to time. 

[0056] For this reason, data sent by the paired volume 
re-synchronization of the paired logical volumes asso- S5 
ciated with the normal interface cables is sent faster with 
respect to time than data sent by the paired volume re- 
synchronization of the paired logical volumes using the 



faulty interface cables. This means that the time neces- 
sary for the paired volume re-synchronization in the 
present invention is shorter than that in the prior art sys- 
tem. In other words, the paired volume re-synchroniza- 
tion of the paired logical volumes using the normal in- 
terface cables is already started when the fault was re- 
moved. Therefore, when compared with the case where 
the re-synchronization of all the paired logical volumes 
after the fault removal, a data transfer amount at the time 
of the paired volume re-synchronization of the paired 
logical volumes after the fault removal is less required, 
and the paired volume re-synchronization is completed 
after the fault removal. That is, a time necessary for re- 
turning to the normal operation is made short. 
[0057] In the step 204, after the S-VOLs were 
changed to the "suspend" status, the paired logical vol- 
umes of the S-VOL and T-VOL are also changed to the 
"suspend" status, thus holding the data state of the vol- 
ume group at the time of a fault occurrence. For this rea- 
son, even when a new fault takes place in the middle of 
the paired volume re-synchronization of a part of the 
paired logical volumes to produce an abnormal status 
management and this leads to the fact that the normal 
relationship between the P-VOL and S-VOL cannot be 
kept and the abnormal state cannot be recovered, the 
present invention can recover the abnormal state using 
the data of the T-VOL. Thus the present invention can 
keep a data guarantee level higher than the prior art 
where the fault is restored and then ail the paired logical 
volumes are restarted. 

[0058] The above explanation has been made as to 
the case where one of the plurality of data transfer units 
forming the interface cables 1 09 and multiple line/public 
network interface l/F 130 was stopped due to a fault. 
Explanation will next be made as to a case where the 
data transfer unit is intentionally stopped. 

(2) As to Periodically Stopping Data Transfer Unit 

[0059] In order to intentionally stop a data transfer unit 
due to maintenance or configuration change, the user 
first issues an instruction from the application 113 to 
change the status of all the paired logical volumes in the 
volume group to the "suspend" (step 21 4 in Fig. 4). The 
status of the paired logical volumes when the operation 
of the step 214 in Fig. 4 was finished, corresponds to 
the division (1) of Fig. 6. 

[0060] The MCU 102, when accepting the suspend in- 
struction, changes the status of the status management 
table managed by the MCU 1 02 from the "duplex" to the 
"suspend" and issues an instruction to the RCU 104 to 
change the status of the table thereof similarly. The RCU 
104, when accepting the instruction from the MCU 102, 
changes the status of the status management table 
managed by the RCU 1 04 from the "duplex" to the "sus- 
pend". Thereby all the paired logical volumes in the vol- 
ume group are put in the "suspend" status where the 
reflection of the write data of the P-VOL 108 on the 
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S-VOL 111 is suspended, and the data contents of the 
P-VOL 108 coincides with those of the S-VOL 111 (step 
203 in Fig. 4). The status of the paired logical volumes 
when the operation of the step 203 was completed cor- 
responds to the division (2) of Fig. 6. And forthe purpose 5 
of intentionally stopping the data transfer unit, the user 
stops the data transfer unit at this time point (step 215 
in Fig. 4). 

[0061] When the status of the S-VOL 111 is changed 
to the "suspend", the RCU 1 04 next changes the status 
of the paired logical volumes of the S-VOL 111 and 
T-VOL 1 1 2 in the RCU 1 04 to the "suspend". At this time 
point, the data contents of the T-VOL 112 coincides with 
the data contents of the S-VOL 111 when all the paired 
logical volumes of the volume group are changed to the 
"suspend". Further, from this time on, even when the da- 
ta contents of the S-VOL 111 was changed, the data 
contents of the T-VOL 1 1 2 will not be changed (step 204 
in Fig. 4). The status of the paired logical volumes when 
the operation of the step 204 in Fig. 4 was completed 
corresponds to the division (3) of Fig. 6. 
[0062] Next, when the MCU 102 accepts from the 
RCU 104 a notification that the paired logical volumes 
of the S-VOL 111 and T-VOL 112 were changed to the 
"suspend" status, the MCU 1 02 identifies the P-VOL 1 08 
having an attribute "enable" in the status management 
table and performs the paired volume recreation over 
the paired logical volumes as a pair of the P-VOL 108 
and S-VOL 111. That is, the MCU 1 02 transfers the write 
data of the P-VOL 1 08 to the S-VOL 111, whereas, the 
RCU 1 04 accepts the write data, reflects it on the S-VOL 
111 , and informs the MCU 102 of the data acceptance 
(step 206 in Fig. 5). The status of the paired logical vol- 
umes when the operation of the step 206 in Fig. 5 was 
completed corresponds to the division (4) of Fig. 7. 
[0063] In the step 206, the paired volume recreation 
is carried out over all the paired logical volumes in the 
volume group. With respect to the paired logical vol- 
umes whose duplication maintenance cannot be kept 
due to the stoppage of the data transfer unit, however, 
the RCU 1 04 does not inform the MCU 1 02 of the write 
data acceptance. In this case, the MCU 102 stops the 
transfer of the write data of the paired logical volumes 
not informed, that is, the transfer of the write data of the 
P-VOL 1 08 and changes the attribute from the "enable" 
to the "disable" (step 207 in Fig. 5). With respect to the 
paired logical volumes informed of the write data accept- 
ance from the RCU 104, the MCU 102 continues to 
transfer the write data. As a result, a part of the paired 
logical volumes in the volume group can be made a pair. 
[0064] Next the user releases the paired logical vol- 
ume intentionally put in the suspend status from the vol- 
ume group. That is, the user reboots the data transfer 
unit so far intentionally stopped (step 209 in Fig. 5). 
[0065] Then the user, when confirming that the data 
transfer unit was rebooted, issues an instruction from 
the application 113 to perform the paired volume recre- 
ation over all the paired logical volumes of the attribute 



"disable" other than the paired volumes so far recreated 
among the paired logical volumes in the volume group. 
As in the case of the aforementioned paired volume rec- 
reation, the MCU 102, when accepting the instruction, 
transfers the write data of the P-VOL 108 to the S-VOL 
111 ; whereas, the RCU 104 accepts the write data, re- 
flects it on the S-VOL 111, and informs the MCU 1 02 of 
the data acceptance (step 210 in Fig. 5). The status of 
the paired logical volumes and the state of the status 
management tables of the MCU and RCU when the op- 
eration of the step 210 in Fig. 5 was completed, corre- 
spond to the division (5) of Fig. 7. 
[0066] The user confirms on the application 113 that 
all the paired logical volumes in the volume group were 
changed to the "duplex" status. Further, since all the 
paired logical volumes of the P-VOL 1 08 and S-VOL 1 1 1 
defined as the volume group were duplicated, the MCU 
1 02 and RCU 1 04 change all the attributes of the status 
management tables to the "enable". As a result, all the 
paired logical volumes in the volume group have been 
recreated pairs (step 211 in Fig. 5). 
[0067] For preparation of the next paired volume rec- 
reation, the user also recreates pairs of the paired logi- 
cal volumes of the S-VOL 111 and T-VOL 112 on the 
application 114 (step 212 in Fig, 5). Although the status 
of the paired logical volumes and the state of the status 
management tables of the MCU 102 and RCU 104 when 
the operation of the step 212 in Fig. 5 was completed, 
correspond to the division (6) of Fig. 7, the status of the 
paired logical volumes in that division is the same as the 
status of the division (1 ) in Fig. 6 before the data transfer 
unit is stopped. 

[0068] As has been explained above, even the data 
transfer unit was intentionally stopped, as in the case of 
the data transfer unit stopped due to the fault, the paired 
volume re-synchronization of the paired logical volumes 
using the interface cables not including the intentionally- 
stopped data transfer unit is restarted before rebooting 
of the stopped data transfer unit. Thus, when compared 
with the case where all the paired logical volumes are 
re-synchronized after completion of the intentional stop- ' 
page of the data transfer unit, a data transfer amount at 
the time of the paired volume re-synchronization after 
the intentional stoppage is less required. As a result, a 
time taken from the completion of the intentional stop- 
page of the data transfer unit to the completion of the 
paired volume re-synchronization is made short. 
[0069] The foregoing explanation has been made as 
to the case where, due to the unexpected fault or inten- 
tional stoppage of one of the data transfer units for its 
maintenance forming the interface cables 1 09 and mul- 
tiple line/public network interface l/F 130, the copying of 
ail the paired logical volumes so far duplicated in the 
volume group is once stopped and all the paired logical 
volumes in the volume group are again duplicated. 
[0070] In the present embodiment, though not ex- 
plained in detail, the user may issue an instruction on 
the application not only from the host unit but also from 
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a management console exclusive to the disk subsys- 
tem. Further, when the data transfer unit is intentionally 
stopped, the user may identify the paired logical vol* 
umes which cannot recreate a pair due to the stoppage 
of the host unit, and give an instruction from the appli- 5 
cation to change the attribute of the logical volume to 
the "disable". Further, the remote copying configuration 
in accordance with the present embodiment has been 
applied to the system configuration where the MCU 1 02 
of the main center 1 01 is connected to the RCU 1 04 of 10 
the remote center 1 03 in a 1 :1 relationship as shown in 
Fig. 1. However, the remote copying configuration may 
also be applied as another embodiment to a case when 
a plurality of MCUs 102 are associated with a single 
RCU 104, when a single MCU 102 is associated with a *5 
plurality of RCUs 1 04, or when a plurality of MCUs 1 02 
are associated with a plurality of RCUs 1 04. 
[0071] When a plurality of MCUs 102 are associated 
with a single RCU 104, the mechanism of maintaining 
the data writing sequence of the volume group becomes 20 
complicated, it will be first explained with reference to 
Fig. 3. The MCU 102, when accepting the write data 
from the host unit 1 05, attaches a time stamp and a se- 
quence number to the write data, and delivers the data 
to the RCU 1 04 asynchronously with the data writing by 25 
the write instruction of the host unit 105. The order of 
the accepted write data does not coincide necessarily 
with the order of the sequence number in the RCU 1 04, 
so that the write data are rearranged in the sequence 
number order and then written in a memory within the 30 
RCU 104. Further, the RCU 104 manages the accepted 
write data for each MCU as a sender originator. The cri- 
terion of this management is, e.g., the manufacturing 
number of the disk subsystem which can identify each 
MCU. 35 
[0072] Next the RCU 104 finds the time value (time 
stamp) of the latest one of the data having the ensured 
sequence for each MCU. In the example of Fig. 3, the 
time value of the latest data of the MCU#1 is T7, and 
the time value of the latest data of the MCU#2 is T5. And 40 
the time values of the latest data between the MCUs are 
compared, the oldest time is determined as the justified 
time (time with a consistent writing sequence kept) and 
the S-VOL 111 of the magnetic disk drive reflects data 
prior to the time value. In the example of Fig. 3, the jus- *5 
tif ied time is T5 and the S-VOL 1 1 1 reflects data prior to 
T5. Further, even when there are a plurality of RCUs, 
the time values of the latest data are compared between 
the RCUs and the oldest time value is set as the justified 
time. so 
[0073] In the summary of the present invention, 
among the paired logical volumes defined as the volume 
group, the paired logical volumes not affected by the 
held duplication even after the stoppage of the data 
transfer unit continuously maintain the duplication even 55 
during the stoppage of the unit, and only the paired log- 
ical volumes which cannot hold the duplication due to 
the stoppage of the unit are duplicated after recovery of 
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the unit (paired volume recreation). Thus, the duplicat- 
ing capacity after the recovery of the unit becomes 
smaller than the capacity of all the paired logical vol- 
umes in the volume group. As a result, a time taken up 
to completion of the paired volume recreation of all the 
paired logical volumes in the volume group can be made 
shorter than that when all the paired logical volumes in 
the volume group are collectively subjected to the paired 
volume recreation, enabling earlier duplication. Further, 
since the present invention uses such a writing proce- 
dure as shown in Fig. 3, even when there are a plurality 
of sender side MCUs, the time necessary for the paired 
volume recreation after stoppage of the data transfer 
unit can be shortened with the ensured consistency of 
the data. At this time, when the justified time is used, 
even a data time ensured by the volume group can be 
known. 

[0074] The above explanation has been made in con- 
nection with the case where the public line for transmis- 
sion of data to the remote subsystem has a data transfer 
delay fault. However, so long as the transmission line is 
limited in its data transmission capability for some rea- 
son (for example, the data transfer capability is limited 
by other remote copy or traffic, a bad transfer quality 
causes frequent retransmission, requiring a lot of trans- 
mission time, etc.) during transmission of the data for 
paired volume recreation from the main center to the re- 
mote center, a time for necessary for the paired volume 
recreation can be shortened by applying the present in- 
vention thereto, that is, by shifting the paired volume rec- 
reation timing. 

[0075] In the foregoing explanation, further, although 
the user issued the instruction to start the paired volume 
recreation of the volumes associated with the data 
transfer units not stopped, microprocessors in the MCU 
and RCU may automatically judge the contents of the 
status management tables and issue an instruction to 
perform the paired volume recreation. 
[0076] In the remote copy function, by carrying out the 
paired volume recreation of paired logical volumes in the 
volume group sequentially on each volume basis, a time 
taken until completion of the paired volume recreation 
of ail the paired logical volumes in the volume group can 
be reduced. 



Claims 

1 . A storage system data duplication method for cop- 
ying data of a plurality of logical volumes (1 08) pos- 
sessed by a first storage system (1 02) to a second 
storage system (104), comprising the steps of: 

(a) copying the data of said plurality of logical 
volumes to said second storage system; 

(b) interrupting copying of the data of said plu- 
rality of logical volumes to said second storage 
system; 
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(c) starting copying of data of one or more of 
said plurality of logical volumes to said second 
storage system; and 

(d) starting copying of data of ones of said plu- 
rality of logical volumes other than said one or 
more logical volumes to said second storage 
system as delayed from said step (c). 

2. A method according to claim 1 , further comprising: 

(e) writing said copied data to a plurality of log- 
ical volumes (111 , 112) in said second storage 
system (104), 

wherein a writing order of said data to said log- 
ical volumes in said first storage system coincides 
with a writing order of the data to said logical vol- 
umes in said second storage system. 

3. A storage system data duplication method for cop- 
ying data of a plurality of logical volumes (1 08) pos- 
sessed by a first storage system (102) to a second 
storage system (104), comprising the steps of: 

(a) starting copying of data of some of said plu- 
rality of logical volumes to said second storage 
system; and 

(b) starting copying of data of the other logical 
volumes than said some logical volumes to said 
second storage system as delayed from said 
step (a). 

4. A method according to claim 3, further comprising 
the step of: 

(c) writing said copied data to a plurality of log- 
ical volumes (111, 112) of said second storage 
system (104) corresponding to said plurality of 
logical volumes (108), 

wherein a writing order of said data to 
said logical volumes of said first storage system 
coincides with a writing order of the data to said 
logical volumes of said second storage system. 

5. A method according to claim 3, wherein said step 
(a) of referring to states of data transfer units used 
when the data of said some logical volumes are 
copied prior to starting of the copying of said some 
logical volumes. 

6. A method according to claim 3, further comprising: 

(d) creating a replication of the data copied to 
said second storage system within said second 
storage system after said step (b). 
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sessed by a first storage system (1 02) to a second 
storage system (104), comprising the steps of: 

(a) copying the data of said plurality of logical 
volumes to said second storage system; 

(b) temporarily stopping copying of the data of 
said plurality of logical volumes to said second 
storage system; 

(c) creating a replication of the data copied to 
said second storage system within said second 
storage system after said step (b); 

(d) starting copying of data of one or more of 
said logical volumes to said second storage 
system; and 

(e) starting the copying of data of the other log- 
ical volumes than said one or more logical vol- 
umes to said second storage system as de- 
layed from said step (d). 

A storage system having a first storage system 
(102) and a second storage system (1 04) connect- 
ed to said first storage system for storing a copy of 
data of a plurality of logical volumes (1 08) stored in 
said first storage system, comprising: 

a disk drive provided within said first storage 
system having the plurality of logical volumes 
stored therein; 

a plurality of data transfer units for the data of 
said plurality of logical volumes to be trans- 
ferred; 

a memory for recording states of said data 
transfer units; and 

a processor provided within said first storage 
system for managing a state of the copying of 
the data of said plurality of logical volumes to 
said second storage system on the basis of the 
states of said plurality of data transfer units, 

wherein, when the data of the plurality of log- 
ical volumes are copied, said processor starts the 
copying of a part of said plurality of logical volumes 
priorto the other logical volumes on the basis of said 
states. 



55 



7. A storage system duplication method for copying 
data of a plurality of logical volumes (108) pos- 



11 



WCfYY»IIV .CO 



1 T1 I ^ 



EP 1 217 523 A1 




13 



WSDOCID: <EP. 



1217523A1J_> 



EP1 217 523 A1 




CQ 
< 
O 

LU 
O 

or 

LU 



W ^ *r W -J ft? LU 
s h lL 50h Z 



CM 
O 
CM 



CO 

o 

CM 



LU 7. 

Zco 
UJZ 

K 
5f 



'o!q:X< 

O— O. o & W 
— a! 2 P S2 z <-> 

LU Jn LU < & X CC 

z zk^h 
h- < 

COO 



b< 

LU 

£° 

O cr 

Z< 
LU °- 

XU- 

50 



LU -% 
> Ou 

LUz 
< LU 

zoo: 

CO Sr UJ 
LU^U- 

ZjO< 
Q PC 



z< lu 

ujluo 

S9 o -J — °° 



H ^ LU - ^ 

co<E^< 

LU 1— ■ « ^ 



OCOLJL^LU 
ZljO^* 

xi — i-^o 

O,, CQ £T 

o2 



CO Ll. 

gg 

>.CO-J 

Lj<2< 
< co O 

0<K 

oSi 

LUS2 
T* 

SZ CO 



CO 

LU LU 



> > or 

_ -j 
ooo 

LU > 
a: i 



Lu£ 
a: i 

CL 




< 

a 



CM 



CO OL Z 
Z I— LU =i l— 

£5 < 2= LU CO 

~~ O <- 3 — 



£^5 



LU 



LU 



e 



5pO 



co 



={<o 



15 



wsmr.irv ^cp 



EP 1 217 523 A1 



CO 
O 
CM 



® 



< to 

So 

LU 

o 



1. 

UJ 2 

or o 

2 < 



<3> 



to 

o 

CM 



?? O — UJ 

so i as 

a. o: -J> < 



CO 

o 

CM 



o 

cvl 



a> 
O 

CM 



O 

CM 



LU H 

<o 

ol 

UJ 

u- co 

— ^ 



Q- U_ m 

poJ3 

cog 1°^ 
UijQJ.,, 



LU 

p to 

5 2 

LU r— 
O 

■4. 



IS 

I— LU 

OLI- 
O'S 

LU < 



CM 



00 

o 



0 



Li. 
000° 

Z>lu 
OQ- 



1 



CO 
LU 
h- 

GO 

(X LU 

<< 
jZ 

So 



O hi 
LU X ^ 

^LU^j 

Hlu-J^ 
o~ J < 



LU O 

Q CO 
LUZ 

|g 

LU l2 
ZDC£ 
CO O 
CO LU 



LU LU 

o99o 
Oor i 

a b< 

LU Q_ 
Ql>Z 

o< 



CM 
CM 

SI 



zj-Jb 
Poo a. < 

^Ll^ LO- 
SE O ce j_ 

Q- ? cr u) 

s2oz 



16 



{ 

I 



EP 1 217 523 A1 




17 



3NSonr.ir> «;Pp 



EP 1 217 523 A1 




18 



EP 1 21 7 523 A1 



CO 

CD 

LL. 



8 

* • 

o 
o 

• • 

8 

It 

LU 



Q 
UJ 

LJ. 

H 

co 



4 

(J 



HI 
I— 

LU CQ 

IS or 



clq; 
O 

LU 

or 



CO 

D 

CO 



I 

CO 



o 
or 



i 

a. 



o 



CQ 
< 

z 

UJ 



-J 



O 
I 



I 

O 



LU 
-J 
GO 
< 

z 



2 



00 

< 



LU 
QJO- 

eo 

GO 



CM 

o 
o 

I 



CNi 

o 

* * 

o 



CO 

o 
c 

I 



CO 



LL 

s 

< 



LU 

a. 

CO 

Z> 
CO 



s 

o 

I 



s 

o 
i 

o 



19 

INSOOCID: <EP 1217523A1 I > 



EP 1 217 523 A1 




European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application N urn rx>r 

EP 01 10 3971 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, whore appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (lnLCI.7> 



US 6 044 444 A (OFEK YUVAL) 
28 March 2000 (2000-03-28) 
* abstract * 

column 4, line 8 - line 52 * 
column 13, line 65 - column 14, line 32 



1-8 



G06F11/14 



column 16, line 9 - line 17 * 

column 18, line 53 - line 64 * 

column 28, line 21 - line 28 * 
figures 1,4 * 



EP 1 058 190 A (HITACHI LTD) 
6 December 2000 (2000-12-06) 

* abstract * 

* column 1, line 1 - column 4, line 3; 
figures 2,9 * 

US 6 101 497 A (OFEK YUVAL) 
8 August 2000 (2000-08-08) 

* column 10, line 20 - column 14, line 64; 
figures 1,5* 

W0 00 49500 A (EMC CORP) 
24 August 2000 (2000-08-24) 

* the whole document * 

EP 0 617 362 A (IBM) 

28 September 1994 (1994-09-28) 

* the whole document * 



1,3,5-8 



1,3,5-8 



TECHNICAL FIELDS 
SEARCHED (ttrtJClT) 



1-8 



G06F 



1-8 



The present search report has bean drawn up for atl claims 



Place of t sarcn 



MUNICH 



Dale & completion at me searcn 

12 April 2002 



Examiner 

Bozas, I 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant H taken alone 

Y ; particvdarty relevant If combined with another 

document of !ho same category 
A : techno! ogicaf background 
O : non-written disclosure 
P : intermediate docurr^errt 



T theory or principle underlying the invention 
E : earlier patent document Out published on. or 

after the tiling date 
D : document cited In the appficaSon 
L ; document cited for other reasors 



member of the sa--.e pal en: family, corresponding 
document 



20 



1H I -» 



EP 1 217 523 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 01 10 3971 



This ainex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained ir. the European Patent Office EDP file on 

The European Patent Office is in no way liable tor these particulars which are merely given tor the purpose of information. 

12-04-2002 



Patent document 




Publication 






Patent family 


Publication 


cited in search report 




date 






member's) 


date 


|K fift£4444 


A 


78-03-2000 


LIS 


5742792 


A 


C 1 U"t 1770 








us 


6173377 


Bl 










us 


6052797 


A 


18-04-2000 








us 


5901327 


A 


04-05-1999 








us 


5889935 


A 


JU UJ 1777 


cp median 


H 




JP 


2000347811 


A 










JP 


2001290713 


A 


I 1 U" cUUi 








Lr 


1UDO X 3U 


A? 




US 6101497 


A 


08-08-2000 


us 


6092066 


A 


18-07-2000 








AU 


3224897 


A 


05-01-1998 








0E 


69710578 


01 


28-03-2002 








EP 


0902923 


Al 


24-03-1999 








JP 


2001518210 


T 


09-10-2001 








WO 


9745790 


Al 


04-12-1997 


WO 0049500 


A 


24-08-2000 


us 


6209002 


Bl 


27-03-2001 








EP 


1071993 


Al 


31-01-2001 








W0 


0049500 


Al 


24-08-2000 








US 


2001007102 


Al 


05-07-2001 


EP 0617362 


A 


28-09-1994 


US 


5446871 


A 


29-08-1995 








DE 


69410671 


Dl 


09-07-1998 








DE 


69410671 


T2 


25-02-1999 








EP 


0617362 


Al 


28-09-1994 








JP 


2509460 


82 


19-06-1996 








JP 


6290125 


A 


18-10-1994 








US 


5555371 


A 


10-09-1996 





a-. 

2 

2 

tr 

s 

2 



£ For more details about this annex : see Official Journal of the European Patent Office, No. 12/82 



21 



1217523A1J_> 



